CONSERVATION RELATIONS FOR LOCAL THETA 
CORRESPONDENCE 



BINYONG SUN AND CHEN-BO ZHU 
To the memory of Stephen Rallis 

Abstract. We prove Kudla- Rallis conjecture on first occurrences of local theta 
correspondence, for all type I irreducible dual pairs and all local fields of char- 
acteristic zero. 



1. Introduction and main results 

Fix a triple (D D F, e), where F is a local field of characteristic 0; D is either F, or 
a quadratic field extension of F, or a central division quaternion algebra over F; and 
e = ±1. Denote by l the involutive anti-automorphism of D which is respectively 
the identity map, the non-trivial Galois element, or the main involution. 

Throughout this article, let V be an e-Hermitian right D-vector space, namely, 
y is a finite dimensional right D-vector space, equipped with a non-degenerate 
F-bilinear map 

{,)v -.V xV 



{u,va)v = {u,v)va, u,v E V, a E D, 



satisfying 
and 

{u,v)v = e{v,u)y, u,veV. 
Denote by U{V) the isometry group of V, namely the group of D-linear auto- 
morphisms of V preserving the form {, )v- It is a classical group, as summarized 
in the following table: 



D 


F 


quadratic extension 


quaternion algebra 


e = 1 


orthogonal group 


unitary group 


quaternionic symplectic group 


e = -1 


symplectic group 


unitary group 


quaternionic orthogonal group 



For convenience, we refer to the various cases by the types of the isometry groups 
in question. 
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Put 

jjUY\ ._ I Sp(V"), if U{V) is a nontrivial symplectic group and F ^ C; 
^ ^ \ U(\/), otherwise. 

Here Sp(y) denotes the metaplectic group, namely, the unique non-spht topolog- 
ical central extension of the symplectic group Sp(l^) by {±1}. 

By an enhanced oscillator representation of U'(V"), we mean a pair {W, u), where 
W is an e-skew-Hermitian left D-vector space, and w is a smooth oscillator repre- 
sentation of the Jacobi group 

J'y{W) := \J\V) X {{V ®D W) X F), 

associated to a fixed nontrivial unitary character ip : F ^ . See Section 12711 for 
details. Similarly denote by U(IV) the isometry group of W, then {\J{V),\J(W)) 
is a type I irreducible dual pair in the sense of Howe jHol] . 

Two enhanced oscillator representations {Wi,Ui) and {W2, ^2) of U'(y) are said 
to be isomorphic if there is an isometric isomorphism Wi = W2 such that cui 
is isomorphic to U2 with respect to the induced isomorphism Jy(Vri) = Jy(W^2)- 
Denote by Qy the set of isomorphism classes of enhanced oscillator representations 
of U'iy). By abuse of notation, we do not distinguish an enhanced oscillator 
representation with its isomorphism class in Qy We also do not distinguish a 
representation with its underlying vector space. The set Qy has a natural additive 
structure which makes it a commutative semi-group (see Section [2?T|) : 

Here and henceforth, "®" stands for the completed projective tensor product in 
the archimedean case, and the algebraic tensor product in the non-archimedean 
case. 

For cr = {W,u) G fiy, we shall refer to the dimension and the split rank of W 
as the dimension and the split rank of cr: 

dim cr := dimD W, 

ranker := ranklV := max {dime F | F is a totally isotropic D-subspace of W}. 
We say that a splits if 

• W splits, that is, dim a = 2 rank a, and 

• for some (and hence all) Lagrangian subspaces Y of W, there is a nonzero 
(continuous in the archimedean case) linear functional on co which is in- 
variant under \J\V) x {V ®d Y) C Jy(W^)- 

As usual, "Lagrangian" means that Y is totally isotropic of dimension ^ . 
There is exactly one isomorphism class of split enhanced oscillator representations 
in each even dimension, and the dimension map 

dim : {a eQv \ <^ splits} ^ {0, 2, 4, 6, • • ■ } 
is a semigroup isomorphism. 
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We say that two elements of the commutative semi-group fiy belong to the same 
Witt tower if they differ by a split element, that is, one of them is obtained from 
the other by adding a split element of Qy This defines an equivalence relation 
in Qy whose equivalence classes are called Witt towers. The set of Witt towers 
in Qy, which is denoted by 2ITy, is a quotient group of the semi-group fly For 
V = 0, the group Wq is the usual Witt group of e-skew-Hermitian left D- vector 
spaces. In general, it is an extension of SHo by the character group of U(V^): 

1 ^ Rom(U{V), C^) ^ SHy ^ SHo ^ 1. 

We refer the reader to Section 12.21 for details. 

As a subset of fiy, each Witt tower t has the following convenient description. 
There is a unique a G t with the minimum dimension, to be called the anisotropic 
degree of t: 

degt := min {dim a | o" G t}. 

An enhanced oscillator representation a = {W,u}) e t is of dimension degt, if and 
only if W is anisotropic. The dimension map then yields a bijection: 

dim : {a \ a et} ^ {degt, degt + 2, degt + 4, ■ ■ ■ }. 

Denote by 1tt{U'{V)) the set of isomorphism classes of irreducible admissible 
smooth representations of U'(V^) if F is non-archimedean, and the set of isomor- 
phism classes of irreducible Casselman-Wallach representations of U'{V) if F is 
archimedean. The reader may consult [Caj and |Wal|. Chapter 11] for more infor- 
mation about Casselman-Wallach representations. 

We are interested in occurrences of irreducible representations in enhanced os- 
cillator representations: for a given a = G fiy and vr G Irr(U'(\^)), one 
seeks to determine whether the following space is nonzero: 

(1) e^(7r) := Homu'(y)(w,7r). 

Here "Hom" stands for the space of (continuous in the archimedean case) linear 
intertwining maps. 

If U'(y) is a metaplectic group, the space 6o-(7r) is nonzero only when the 
non-trivial element of the covering map U'(V) — i- U{V) acts through the scalar 
multiplication by (—1)'^™'^ in vr. When this happens, we say that vr is genuine with 
respect to a. By convention, if V'iV) is not a metaplectic group, we say that every 
irreducible representation in Irr(U'(V^)) is genuine with respect to every element in 
f2y. We say that vr is genuine with respect to a Witt tower t G QIfy if it is genuine 
with respect to some (and hence all) elements of t. 

Assume that vr G Irr(U'(l^)) is genuine with respect to t G 21Jy. There are two 
basic properties concerning non- vanishing of theta liftings: 

• Non-vanishing of theta liftings in the stable range: 

if cr G t and rank a > dimD V, then 6o-(7r) 7^ 0. 
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• Kudla's persistence principle: 

if cri,o"2 G t and dim (72 > dimai, then Q„-^{n) 7^ implies 6o-2(7r) 7^ 0. 

See Section 16.11 for details. Define the first occurrence index 

(2) nt(7r) := min{dimo- \ a e t, 6^(7r) ^ 0}. 

In view of the aforementioned two properties, the first occurrence index is finite 
and is of clear interest. 

Now we introduce some quantities which appear in the conservation relations. 
For r G Z>o, put 

orthogonal group case; 
^''"^ quaternionic orthogonal group case; 



(3) Pr :- Pr,D,F,, 



4 ' 

^, unitary group case 

2r+l 



^ , quaternion symplectic group case; 
symplectic group case. 



When r > 0, 2pr is the normalized exponent of the modulus character of a Siegel 
parabolic subgroup of U{Vr,r), where Vr^r is the split e-Hermitian right D- vector 
space of rank r. See Section H?T1 We note the numbers 4pi = 0, 1, 2, 3, 4, which will 
appear in the sequel frequently. We also note that when F is non-archimedean, 
4pi coincides with the maximal dimension of anisotropic e-skew-Hermitian left D- 
vector spaces, and up to isometric isomorphism, there is a unique such space of 
dimension 4pi. 

In Section [3l we introduce the central object of this article: a subgroup /Cy C 
SUy, which we call the Kudla kernel in 2ITy. 

First assume that F is non-archimedean. Then /Cy has order 2, unless U{V) 
is the trivial orthogonal group (in which case Ky = 22Jy = 0). Denote by ty 
the generator of /Cy, and call it the anti-split Witt tower in 2ITy. It may be 
characterized as the unique element of SHy such that 

(4) degty = 4pi and nt^(ly) = 4pdimD v + 2. 

Here and throughout this article, ly G Itt{1]'{V)) stands for the trivial represen- 
tation. The first equality in (jl]) says that ty has maximal anisotropic degree. In 
view of the obvious equality 

4pdimD y + 2 = 4pi + 2 dime V, 

the second equality in @ asserts that the trivial representation only occurs in 
ty when it has to, namely in the stable range. The element ty is explicitly de- 
termined in all cases. For example, when U(^) is an orthogonal group, ty G 
QUy = Hom(0(l^), C^) is the sign character, and when U(y) is a symplectic 
group, ty G Wv = SUo is represented by the division quaternion algebra over F. 

In the non-archimedean case, the conservation relations, as conjectured by Kudla 
and Rallis, assert the following: 
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Theorem A. Assume thatF is non-archimedean. Let ti and t2 be two Witt towers 
in QlJy with difference ty- Then for every ti G Irr(U'(l^)) which is genuine with 
respect to ti (and hence genuine with respect to 12), one has that 

nti(7r) + nt2(7r) = 4pdimDV + 2. 
Now we consider the archimedean case. Then three different phenomena occur. 

Case I: U{V) is a real or complex orthogonal group. Then as in the non-archimedean 
orthogonal case, /Cy = {l,ty} and ty corresponds to the sign character of 0{V). 
The same conservation relations hold: 

Theorem B. Assume that U{V) is a real or complex orthogonal group. Let ti and 
t2 be two Witt towers in QUy with difference ty. Then for every tt G Itt{0{V)) 
one has that 

nti (tt) + nt2 (vr) = 4pdimD v + 2 (=2 dime V) . 

Case II: U{V) is a complex symplectic group or a real quaternionic symplectic 
group. Then Hom(U(\^), C^) = {1}, and 

/Cy = 2IJy = = {0 = t^™^ ty = t^^^^} 

is a group of order 2, where t^*^"^ and ty^'^ are the Witt towers of even and odd 
dimensional spaces, respectively. We may check from the explicit duality corre- 
spondence ( |ABll Section 2] and [LPTZl Section 5]) that conservation relations 
fail in this case. For example, if is a complex symplectic space of dimension 2, 
then nt^cn(7r) + ntodd(7r) equals 3 if vr is the trivial representation or one of the two 
irreducible constituents of the oscillator representation of U(\^) = SL2(C), and 
equals 5 otherwise. 

Case III: U(V^) is a real symplectic group, a real unitary group, or a real quater- 
nionic orthogonal group. Then /Cy = Z, and we have the following 

Theorem C. Assume that U(V) is a real symplectic group, a real unitary group, 
or a real quaternionic orthogonal group. Let T C QUy be a JCy-coset. Let vr G 
Irr(U'(V)) be an irreducible representation which is genuine with respect to some 
(and hence all) elements ofT. Then there are two different elements t,t' G T 
such that 

nt(7r) + nt'(7r) = 4pdimDy + 2; 
and for any two different elements ti,t2 G T, one has that 

nt,(7r) + nt2(7r) > 4pdimoy + 2 + 4pi(|ti - tsl - 1), 
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where for t G ICy, |t| denotes the nonnegative integer so that t is \t\-multiple of a 
generator of K,y. Consequently the following conservation relations hold: 

^ mm{nt(7r) | t G Q} = 4pdimDV + 2. 

QGr/2/Cv 

Remarks: (a) For orthogonal-symplectic and unitary-unitary dual pairs, the con- 
servation relations were conjectured by Kudla and Rallis in the mid 1990's. For 
quaternionic dual pairs, the conjectured statements first appeared in Gan-Tantono 
|GTanl Section 4]. 

(b) For j9-adic orthogonal-symplectic dual pairs and vr supercuspidal, the con- 
servation relations were due to Kudla and Rallis |KR3] . This was later extended 
to all type I irreducible dual pairs by Minguez |Mi] . again for p-adic F and tt 
supercuspidal. 

(c) The inequality (tt) -|- (vr) > 4/9dimD y + 2 is due to Kudla- Rallis |KR3l 
Theorem 3.8] (for p-adic orthogonal-symplectic dual pairs) and Gong-Grenie [GGl 
Theorem 1.8] (for p-adic unitary- unitary dual pairs, following an earlier work of 
Harris-Kudla- Sweet |HKS] ). See also Gan-Ichino \G1\ Theorem 5.4]. 

(d) The conservation relations for complex orthogonal groups were proved by 
Adams-Barbasch |AB1] using the explicit duality correspondence. Also for F = M, 
A. Paul proved the conservation relations for unitary-unitary dual pair correspon- 
dence |Pa2t Theorem 1.4], for a discrete series representation, or a representation 
irreducibly induced from a discrete series representation. 

In addition to the above historical remarks, the authors would like to emphasize 
the deep influence of the ideas of Kudla and Rallis on this article, in particular 
the use of degenerate principal series. The proof of our results follows their ap- 
proach |KR3j . There are two ingredients: an upper bound and a lower bound. 
For the upper bound, our main contribution (Proposition 14. 2p is to pinpoint and 
to recognize the role of certain structure results about degenerate principal se- 
ries representations, which fortunately can be read off from results in the existing 
literature. It identifies the (individual) contribution of a certain submodule R^r 
(first employed in the influential paper of Rallis jRalj ) in the degenerate princi- 
pal series. This will imply the required existence/occurrence result (Proposition 
16.51) . Note that Proposition 14.21 does not hold when U(\^) is a complex symplectic 
group or a real quaternionic symplectic group. Our second main contribution is 
to introduce the notion of Kudla kernel. The key technical result (Proposition 
15. ip . as remarked previously, is that for the Witt tower represented by a nontrivial 
element of the Kudla kernel, the trivial representation only occurs in the stable 
range. This is responsible for the lower bound. For non-archimedean orthogonal- 
symplectic and unitary- unitary dual pairs. Proposition 15.11 is a reformulation of 
results of Rallis, Kudla-Rallis and Gong-Grenie. All archimedean cases are also 
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known |Pr2[ IPa2[ ILPTZ[ ILL] . So only the non-archimedean quaternionic case of 
Proposition 15.11 is really new. Note that due to the lack of MVW-involutions, 
the approach of Kudla-Rallis and Gong-Grenie, which uses the doubling method, 
does not work for this case. We follow the idea of Rallis ([Rail IRa2] . which treat 
the case of orthogonal groups) to provide a uniform proof of Proposition 15.11 in 
all non-archimedean cases. We remark that our methods to establish both upper 
and lower bounds are invariant-theoretic: ultimately the upper bound rests on 
the existence, and the lower bound rests on the non-existence, of certain invariant 
distributions. 

As pointed out by Kudla and Rallis |KR3j . the conservation relations imply theta 
dichotomy phenomenon in the non-archimedean cases. The latter was established 
by Harris |Hat Theorem 2.1.7] (for unitary-unitary dual pairs), and Zorn |Zot 
Theorem 1.1], and by Gan-Gross-Prasad |GGPl Theorem 11.1] (for orthogonal- 
symplectic dual pairs). For a related work of Prasad, see [Pra] . For F = M, the cor- 
responding (though more complicated) result was established by Adams-Babasch 
|XB2l Corollary 5.3], Paul jPaTl Introduction], and Li-Paul- Tan-Zhu [LPTZi In- 
troduction], using Vogan's version of the Langlands classification. See also the 
work of Moeglin |Molj . The conservation relations proved in this article thus yield 
a shorter proof for the afore-mentioned (archimedean) results, as one of the by- 
products. Other works where conservation relations are exploited include those of 
Gan-Takeda [GTakj . Moeglin po2] . and Gan-Qiu-Takeda |GQT| . 

The article is organized as follows. In Section |2l we introduce the semigroup 
of enhanced oscillator representations, the associated Witt group, and we discuss 
the natural operation of restrictions. In Section |3l we introduce the notion of 
Kudla characters and Kudla kernels, and we determine the latter explicitly in 
all cases. In Section HI we review some structure results of degenerate principal 
series of U'{V) for V split and the doubling method, along with some technical 
preparations towards non- vanishing of theta liftings. Section O is devoted to the 
phenomenon of non-occurrence of the trivial representation before stable range. 
As pointed out earlier, the idea is due to Rallis and it consists of reduction to 
the null cone, and within the null cone, proving vanishing on small orbits and 
homogeneity for the main orbits, and finally employing the Fourier transform. It 
is worth mentioning that for the base case (dimD V = 1, and W anisotropic), 
proving non-occurrence of the trivial representation (Lemma 15. Sp again requires 
the use of the doubling method. In the final Section El we derive the conservation 
relations by proving an upper bound and a lower bound, as consequences of the 
results of Sections S] and O respectively. 

Finally the authors would like to thank Wee Teck Gan, Michael Harris, Atsushi 
Ichino and Jian-Shu Li for their interest, as well as comments on an earlier version 
of this article. The authors owe a special thanks to Dipendra Prasad for sending 
us the preprint of Rallis |Ra2] , in addition to his interest and comments. 
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2. Enhanced oscillator representations 

2.1. The semigroup of enhanced oscillator representations. Let W be an e- 

skew-Hermitian left D- vector space, namely, is a finite dimensional left D- vector 
space, equipped with a non-degenerate F-bilinear map 

{,)w -.W xW 

satisfying 

{au, v)w = o-{u, v)w, u,v e W, a e D, 

and 

{u, v)w = -^{v, u)w, u,v eW. 
Recall from the Introduction that V is an e-Hermitian right D-vector space. The 
tensor product V (g)D is a symplectic space over F under the form 

/ / /\ {v,v')v {w,w')\y + (w,w')w {v,v')v I / TT^ 

{v®w, v'®w')v^^w ■■= — ^ — , V, v' e V, w, w' e W. 

Define the Heisenberg group 

(5) Rv{W):={V^oW)xF, 
whose group multiplication is given by 

{u,t){u',t') := {u + u',t + t' + {u,u)v^j,w), u,u' eV 0bW, t,t'eF. 
Form the semidirect product 

(6) Jv{W) := \J{V) X RviW) 
and its covering 

(7) J'yiW) := U'{V) X Rv(W). 

Fix a non-trivial unitary character : F ^ throughout the article. A 
representation of Jy(H^) is called a smooth oscillator representation (associated to 
ip, unless otherwise specified) if 

• it is a smooth representation if F is non-archimedean, and a smooth Frechet 
representation of moderate growth if F is archimedean; 

• as a representation of Hy(H^), it is irreducible with central character ijj. 

The reader is referred to |dul Definition 1.4.1] or [Su2| Section 2] for the notion 
of "smooth Frechet representations of moderate growth" in the setting of Jacobi 
groups. Smooth oscillator representations of Jy(iy) exist by the well known result 
of splitting metaplectic covers ( |M VWj . see also [Kulj Proposition 4.1]). Denote 
by Qv{W) the set of isomorphism classes of smooth oscillator representations of 
Jy(iy). We shall use the obvious notion of smooth oscillator representations for 
some other semidirect products of reductive groups with Heisenberg groups. 
Similarly, we define the groups U(W^), U'(Vr) and 

JyvK := i^'iV) X U'(W^)) x RviW) D J'y{W). 
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Lemma 2.1. Every smooth oscillator representation of JylW) extends to a smooth 
oscillator representation 0/ Jy^y. 

Proof. Besides splitting of metaplectic covers, this is due to the fact that any two 
elements in a metaplectic group commute with each other if their projections to the 
symplectic group commute with each other [MVWl Chapter 2, Lemma II. 5]. □ 

As in the Introduction, denote by Qy the set of isomorphism classes of enhanced 
oscillator representations of \J'{V). 

Lemma 2.2. Two smooth oscillator representations ui and 002 of Jy{W) are iso- 
morphic to each other if and only if {W,uji) and {W,U2) are isomorphic to each 
other as enhanced oscillator representations ofl]'{V). 

Proof. The "only if part is trivial. To prove the "if part, assume that {W,uji) 
and {W,U2) are isomorphic to each other as enhanced oscillator representations. 
This amounts to saying that there is an element g G U(iy) and a (continuous in 
the archimedean case) linear isomorphism (p : ui ^ UJ2 such that the diagram 



Ui > CO2 



h 



9v{h) 



Ui )■ UJ2 

commutes for every h G JyCW), where gy '■ JyiW) — )■ Jy(Vr) is the automorphism 
induced hj g -.W ^W. 

Using Lemma 12.11 we extend U2 to a representation of J'yw, which we still 
denote by 002- Let g' be an element of U'(H^) which lifts g. Then gvih) = g'hg'^^ 
for every h G Jy(iy). Therefore the diagram 



/-I J. 



Ul > OJ2 



Ul )■ U2 

commutes for every h G JyiW), and consequently, Ui and UJ2 are isomorphic as 
representations of J y(W). □ 

Lemma [2^2] implies that f^y (Vl^) only depends on the isometric class of W, that is, 
all isometric isomorphisms Wi = W2 induce the same bijection Qy{Wi) = Qy(W2). 
It also implies that 

ny = \_\ny{w), 

w 

where W runs though all isometric classes of e-skew-Hermitian left D- vector spaces. 
For any two elements cxi = {Wi,ui) and a2 = (^^2,1^2) in ^y, put 

0"! + := (Wi © W2, C0i®UJ2) G fiy . 
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Note that a;i®a;2 is a smooth oscillator representation of Jy(W^i © W2). it is a 
tensor product representation of IJ'iV), and is a representation of Hy(Vri © W2) 
by descending the representation of Hy(14^i) x Hy(Vr2) through the quotient map 

B.v{Wi) X Hy(Vr2) ^ ^viWi © W2), h; U2, ^2) ^ (mi + ^2, + ^2)- 

The operation "+" defines a commutative semigroup structure on Qy. 
We may also define the contragredient operation on Qy by 

(8) {W,uy := {W-,uj'') efly, 

where W~ is the space W equipped with the form scaled by —1, and cu^ is the 
smooth oscillator representation of J'yiW') which is contragredient to cu with 
respect to the isomorphism 

yy{W^) = V'{V) ^ {{V (8)Y)W-) xF) -> J'yiW) = V'{V) X {{V ®bW) xF), 

{g;u,t) {g;u,-t). 

When W = 0, a smooth oscillator representation of Jy(0) is just a character of 

\j{vy. 

(9) Qv{0) = Hom(U'(K), C^) = Hom(U(F), C^). 

Note that Qy{0) is a subgroup of the semigroup Qy. We remark that all charac- 
ters of FJ{V) are unitary, and all smooth oscillator representations of Jy(l^) are 
unitarizable. 

2.2. The Witt group of enhanced oscillator representations. We use the 

following notation throughout this article: given {W, u) G Qy and a Lagrangian 
subspace L of the symplectic space V<^dW, let Al denote a nonzero (continuous in 
the archimedean case) linear functional on u which is invariant under L C Hy(14^). 
It is unique up to multiples. See jHo2l Theorem 5.1]. 

Let a = {W,u) G Qy. Suppose that W is split. We pick a Lagrangian subspace 
Y of W, and define a character Xcr on U'{V) by the formula 

(10) >^v<S)-DYi9 ■ v) = xA9)Xv<^=ioYiv), g e\J'{V), V e u. 

Lemma 12.11 implies that the character Xa is independent of Y. We therefore have 
a semigroup homomorphism: 

(11) □ Qy{W)^}iom{\J'{V),C'<), a^Xa. 

W splits 

Note that the restriction of (fTTj) to Qy{^) coincides with the identification ([9]). 
Lemma 2.3. For every e-skew-Hermitian left D-vector space W , the action 

Qy{Q)xQy{W) ^Qy{W), (x, ^ ) ^ X + ^ 

is simply transitive. 
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Proof. Transitivity is clear. Assume that x + o" = a. Then 

X + ia + a"^) = (j + a^. 
We conclude that x = 1 by applying the homomorphism f|TT]) to the above. □ 

As in the Introduction, a = (W, u) G fly is said to be split if W is split and Xo- 
is trivial. It is clear that cr + cr^ splits for all a G Qy- 

Lemma 2.4. Let o"i, o"2 G Qy- If both 02 and ai + o"2 split, then so does ai. 

Proof. Write ai = (Wi,ui). Witt's cancellation theorem implies that Wi splits, 
and the equahties 

implies that Xo-i =1- D 

Recall also that two elements cxi, (T2 G fiy are said to be in the same Witt tower 
if they differ by a split element. By Lemma 12. 4[ this amounts to saying that 
o'l + (y'l splits, and defines an equivalence relation on f2y. An equivalent class of 
this relation is called a Witt tower in f2y. 

Denote by 2ITy the set of Witt towers in fiy. This is a quotient group of the 
semigroup f2y. Its zero element is the Witt tower of split elements, and the inverse 
map is induced by the contragredient operation a 1— )■ cx^. 

Note that when = 0, SHq equals the Witt group of e-skew-Hermitian left 
D- vector spaces, which is well understood in all cases (cf. |Sch] ) . The following 
sequence of abelian groups is exact: 

(12) 1 ^ ^]y(0) ^ SUy ^ SHo ^ 1, 

where gy : SUy — )■ SUq is the map of sending the class of (W, uj) to the Witt class 
of W . Note also that the character group ny(0) is explicitly calculated in all cases 
(cf. [Wa]). 

2.3. Restrictions of enhanced oscillator representations. Let V be an e- 

Hermitian right D-vector space so that V is isometrically embedded in V: 

V ^ v. 

Denote by the orthogonal complement of V in V. Then the induced embedding 
U{V) X \J{V^) ^ U(^') uniquely lifts to a homomorphism 

(13) V'{V) X V'{V^) ^ V'{V'). 

For every e-skew-Hermitian left D-vector space W, combining ( IT3|) with the 
homomorphism 

Rv{W) X Hyx(l^) ^ Rv'{W), {u,t;u',t') ^ {u + u,t + t'), 
we obtain a homomorphism 

(14) j'yiW) X j'y^iW) ^ J'y,(iy). 
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The restriction of every u' G Vtv'iW) through f[T^ is uniquely of the form 

(15) u'\y^(w)y^y^^(w) = Uj'\y®u'\v^., 

where uj'\v € VtyiW) and w'jyx G Vty^iW) are defined via the above. In turn this 
defines a semigroup homomorphism 

(16) : VLv' Qv, {W, u') ^ {W, u'lv). 
It further descends to a group homomorphism 

(17) T^' : Wv 
It is clear that the diagrams in 

(18) 1 ^nv'{0) -mJo -1 



1 fiy(O) Wv SHo 1 

are commutative, where the map ly' of left vertical arrow is the restriction of 
characters. Therefore the group QUy is determined by QUy/: 

{i4'ix),x-')\xeny,{o)y 

Lemma 2.5. The restriction maps in f ll6p and (IT7|) are independent of the iso- 
metric embedding V ^ V . Furthermore the restriction maps are isomorphisms 
in the following cases: 

(i) V is a symplectic space or a quaternionic Hermitian space; 

(ii) V is a nonzero Hermitian or skew- Hermitian space; 

(iii) V is a non- anisotropic orthogonal space or a non- anisotropic quaternionic 
skew- Hermitian space. 

Proof. If V = V, then every isometric isomorphism V ^ V induces an inner 
automorphism Jy(iy) — )■ Jy{W), and consequently, both flTB]) and f lT7|) are identity 
maps. In general, use Witt's extension theorem and apply the above argument to 
V, we conclude that the maps in f lTB]) and f lT7|) are independent of the embedding 
V ^ v. This proves the first assertion. 

The second assertion follows from the commutativity of the diagrams in (flSjl . 
and the calculation of the character groups of classical groups (cf. |Wal Section 
2]). □ 

By the above lemma, the semigroup Qy and the group SHy only depend on the 
isometric class of V, namely, if V is isometrically isomorphic to V, then all different 
isometric isomorphisms induce the same semigroup isomorphisms Qy = Qy/, and 
the same group isomorphism Wy = SUy. 
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If V is non-anisotropic, we denote 

(19) Wy ■.= 4'{Wv')cWv. 
It is independent of V by Lemma 12.51 

Lemma 2.6. We have that 

Proof. This is because that the map qy '■ SHy — )■ Q2Jo has kernel f2y(0) and is 
surjective when restricted to QUy. □ 

3. KUDLA CHARACTERS AND KUDLA KERNELS 

In Sections 13.11 to 13. 3[ we assume that V is split and nonzero. We define the 
notion of the Kudla character of t G QUy and concretely realize it as a character 
of a compact abelian group K'. In Section 13. 4[ we introduce the Kudla kernel in 
QUv for an arbitrary V. This is defined by way of restriction from a nonzero split 
V using the Kudla character map of QUv- 

3.1. Kudla characters of enhanced oscillator representations. For every 
Lagrangian subspace X of V, denote by P{X) the parabolic subgroup of U(y) 
stabilizing X, and by P'{X) -)■ P(X) the covering induced by H'iV) -> HiV). 
We use I ■ |x to denote the following positive character on P'{X): 

(20) P'(X) ^ P(X) '•°^^"^*"°°°^> GL(X) ^ E>^ '4" M!^. 

Here and henceforth E is the center of D, "det" stands for the reduced norm, | ■ |e 
is the normalized absolute value on E, and do is the degree of D over E, which is 
2 if D is quaternion, and is 1 otherwise. 

Let a = {W, u) G Qy Define a (unitary) character k^^x on P'{X) by the formula 

dim a 

(21) >^x»j,w{9 ■ v) = K„,x{g)\g\x'' >^x<iiow{v), g eP'{X), V e uj. 
Lemma 3.1. IfY is another Lagrangian subspace ofV, then 

i^a,x{g) = i^axig) 

for all g G P'(X) nP'(r). 

Proof. By Jordan decomposition, we may assume without loss of generality that 
g is semisimple, namely the image go of g under the quotient map U'(l^) — > U(y) 
is semisimple. Then it is elementary to see that there is a go-stahle Lagrangian 
subspace Y' of V such that 

V = X®Y' and Y = (Y n X) ® (Y HY'). 

We realize C(;|H^(iy) on the space of Schwartz half densities (cf. [Lil Section 1.1] 
for the notion of "Schwartz half densities") on X (g)D W, with the following action: 
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• The action of n G X (8>d W is the pushing forward of half densities through 
the translation by u. 

• The action of f G F'cg)^ W is multiplication by the function ip{{2v, ■)v®w)- 

1/2 

Denote by /ix a Haar measure on X W, and by fi^ square root, which 
is a half density on X (g)^ W. Up to scalar multiplication, the functional Xx^uW 
is given by 



JX®oW 

where / is a Schwartz function on X W. The functional Xy(S)oW is given by 



J(XnY)®r,W 



'iXnY)(g)oW 

where fi(xnY is a Haar measure on (X fl Y) ®d M/^. 

Note that g acts as cg^, under the oscillator representation u, for some complex 
number c of modulus 1, where g^, is the pushing forward of half densities through 
the map go<S) I X ®d W ^ X ®d W. Now it is routine to verify that 



l^a,x{g) = K^axig) = C. 



□ 



By Lemma 13.1^ we get a well defined map 
(22) : U'(npiit := IJ P'(X) ^ C^ 

X is a Lagrangian subspace of V 

which maps g G P'{X) to n^^xio)- Obviously the map k,^ has the following two 
properties: 

• it is U'(l^)-conjugation invariant; 

• its restriction to each P'{X) is a continuous group homomorphism. 

For any abelian topological group A, denote by Hom(U'(V)spiit, A) the group of 
all maps from U'(V^)spiit to A with the afore mentioned properties. We call 



(23) G Hom(U'(\/)spiit,C 



X ^ 



the Kudla character of cr G Qy 

We omit the proof of the following lemma, which is similar to (but easier than) 
that of Lemma I3.1[ 



Lemma 3.2. The map k^j is trivial if a E Qy splits. Consequently a ^ 
descends to a group homomorphism 

(24) 2nv-^Hom(U'(l^)spiit,C><), i ^ k,. 
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3.2. The group Hom(U'(y)spiit, C^). We first consider the case of hnear groups. 
Put 

U(l^)spiit := U P(X). 

X is a, Lagrangian subspace of V 

Similar to Hom(U'(y)spiit, we define the group Hom(U(K)spiit, ^) for every 
abeliean topological group A. 
Put 

Image of the reduced norm map — )■ 

(25) K := ; — — ^ . 

{xx' I a; e E><} 

(Recall that E is the center of D.) It is always a compact abelian group. Define a 
map 

f^v : U(l^)spiit -> K 

by mapping g G P{X) to the class of det(5'|x) in K. 
We omit the proof of the following elementary lemma. 

Lemma 3.3. The map /ly is well-defined, belongs to IIom(U(y)spiit, K), and is 
surjective. Its pull-back yields a group isomorphism 

Hom(U(r)spiit,A)^Hom(K,A) 

for every abelian topological group A. 

Now assume that we are in the case of metaplectic groups, that is, D = F ^ C 
and e = — 1. We have a two-to-one map 

(26) MV)spiit ^ Sp(K)spiit, 
and a surjective map 

/iy : Sp(y)spiit ^ K = -^i^- 

Put 

K := K X {±1}, 
to be viewed as an abelian group with group multiplication 

(a, t)(a',t') := (aa', tt' (a, a')?), where ( , )f is the Hilbert symbol for F. 
It is an extension of K by {±1}, equipped with a family 

(27) {7^'}^' is a non-trivial unitary character on F 

of characters, where 

28 M<^^t):=t^Y-rTir^^ 

and the two 7's of the right hand side of fl28|) stand for Weil indices (see |Weil[ 
Section 14] or |Weisj ) of non-degenerate characters (on F) of degree two. 



16 BINYONG SUN AND CHEN-BO ZHU 

For every a G F ^ , denote by aip the character of F given by 

{aip){x) = ip{ax), X G F. 
Then it is known that [Rao'j Corollary A. 5.] 

(29) 7v("'^)7qv(^'^) = («, -«)f, {a,t) G K. 

Recall that the Heisenberg group H(V) := x F has the group multiplication 
{u, t){u, t') := {u + u\t + t' + {u, u')v). 
For every non-trivial unitary character ip' of F, denote by u^i the smooth oscillator 
representation of Sp(l^) x H(F) associated to ip' . As a special case of fl2T|) . we 
define a map k^/ G Hom(Sp(V^)spiit, C^) by 

>^i^',xig ■ v) = Ki^'{g)\g\xK',xiv), v g u^', g G P'(X), 

for all Lagrangian subspaces X of V, where X^'^x denotes a nonzero (continuous in 
the archimedean case) linear functional on u^' which is invariant under X C H(V). 

Lemma 3.4. There exists a unique map Jiv '■ Sp(l^)spiit K such that the diagram 
commutes for every non-trivial unitary character ip' ofF. 

Proof. The uniqueness is clear since the family fl27|) of characters separates the 
elements of the group K. We prove the existence in what follows. 

Let g G Sp(y)spiit and denote by go its image under the map Sp(l^)spiit — 
Sp(V^)spiit- Let a G F^. By using the Schrodinger model of the representation 
ijj^(S)OJatp of the group Sp(V^) ( |Ku2t Section II.4]), we have that 

(30) i^i,{g)i^cii,{g) = (/Uy(fi'o), -a)F- 
Then it is elementary to see that f l29p and (13 Op imply that 

l^a^ig) = lai;{fJ'v{go),tg), 

where tg G {±1} is independent of a. Therefore the map g i— j- {jj,y{gQ),tg) fulfills 
the requirement of the lemma. □ 

By Lemma 13.41 and its proof, the diagrams in 

(31) {±1} S^(V^)spiit Sp(V^),piit 

{±1} ^ K ^ K 
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are commutative. Therefore Jly is surjective. It is easy to check that Jly G 
Hom(Sp(l^)spiit, K), and its pull-back yields a group isomorphism 

Hom(S^ (\/)spiit, A) = Hom(K, A) 
for every abehan topological group A. 

We are back in the general case. Put 

( K, if D = F ^ C and e = -1; 
\ K, otherwise, 

and put 



pfy, if D = F ^ C and e = -1; 
' \ jJ'V, otherwise. 

Then in all cases, descending through ft'y : U'(V^)spiit — ^ K' yields an isomorphism 

Hom(U'(y),pHt,C^)^K'. 

Here and henceforth, over a compact abelian group indicates its character 
group. Finally, we get a homomorphism 

I'v ■■ ^ K', 

t i-> the descending of Kt through /i^. 

Lemma 3.5. If V and V are nonzero split e-Hermitian right D-vector spaces so 
that dimD V > dimo V . Then the restriction map 



is an isomorphism and 



z/y = z/y o ry 



Proof. The first assertion follows from Lemma 12.51 Fix an isometric linear em- 
bedding V ^ V\ then the second assertion is a consequence of the fact that the 
diagram 

U'(F)spiit > U'(\/')spiit 

K' K' 

commutes. □ 
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3.3. The homomorphism vy. In this subsection, we examine the homomor- 
phism i/y case by case. We have the usual dimension homomorphism 

dim : Wq Z/2Z. 

Composing it with the map qv '■ 2I?y — )> QUq, we get the dimension homomorphism 

dim : Wy ^ Z/2Z. 

Case 1: U{V) is an orthogonal group. 

Lemma 3.6. If\J{V) is an orthogonal group, then there is an exact sequence 
1 ^ {1, sgn} ^ 2IIy = Hom(0(y), C^) ^ K = F ^(F^)^ ^ 1. 

For every X £ Hom(0(V), C^), z^y(x) equals the descending o/x|so(v) through the 
spinor norm map SO{V) F^/(F^)^. 

Proof. For every non- isotropic vector v &V, denote by 

Sy : V ^ V, u ^-^ — 7^ u 

the reflection along v. Recall that there is a unique homomorphism 

(33) 5y : 0(\/) ^FV(F^)2 

which maps every reflection to the class of {v,v)v- The restriction of Sy to 
SO(l^) is called the spinor norm map. As V is not anisotropic, the homomorphism 

sgn X 6v : 0{V) ^ {±1} x (F7(F^)2) 

is surjective and its kernel is the commutator subgroup of 0{V). Therefore its 
puUback yields a group isomorphism 

Hom(0(V^), C^) ^ {±1} X F><7(F><)2. 
The lemma now follows by noting that the diagram 

u(y)spiit so(y) 



flV 



Sv 



Fx/(FX)2 F^/(F^)2 

commutes. □ 

Case 2: U(K) is a symplectic group and F ^ C. 
Recall the discriminant map (for orthogonal spaces) 

disc:QHo ^ FV(F^)^ 

/ ; \ \ / \ "T,(m— 1) - 

{W,{,)w) H> (-1) ~ det[{ei,ej)w\i<i,j<m: 
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where 61,62, - ■ ■ , is a basis of W. Denote by H the division quaternion algebra 
over F, equipped with the orthogonal form 

(x, y) I— 7- the reduced trace of xy, 

where " " " stands for the main involution of H. By abuse of notation, we still 
use H to denote its Witt class. Then as an element of the Witt group QUq, H has 
trivial discriminant, has order 2 if F is non-archimedean, and has infinite order if 
F = M. 

Lemma 3.7. If\J{V) is a symplectic group and F ^ C, then we have an exact 
sequence 

1 ^ (H) ^ 2IJv = 2IJ0 ^ K ^ 1. 
For every a G QUq, if dim a is even, then 

vy{a){a,t) = (disc(cr),a)F, {a,t) G K = F7(F^)2 x {±1}; 

if dim a is odd, then 

z^y(o-) = 7disc(<T)^/)- 



Proof. In view of the equality fl29|) . this is an easy consequence of Lemma [3 .41 □ 

Case 3: U(\^) is a unitary group. 

In this case, QUq is isomorphic to Z if F = M, and has order 4 if F is non- 
archimedean. Define a homomorphism 

K = Hom(EV{xx^ | x G E^},C7 restriction Hom(FV{xx^ | x G E7,C^) ^ Z/2Z. 

Lemma 3.8. // U(V^) is a unitary group, then the following diagram of abelian 
groups is Cartesian: 

Wv K 



restriction 



QUo Z/2Z. 

Consequently we have an exact sequence 

1 ^ Sn^™"^ ^ 22Jy ^ K ^ 1, 

where QUq™"^ is the kernel of the homomorphism dim : QUq Z/2Z. 

Proof. It follows from the discussion of |HKS[ Section 1] that the image of 

(34) uv X qv -.Wv ^KxWo 

is contained in the fibre product K Xx/2Z SHq- 
Put 

U(E) := {x G E^ xx' = 1}. 



20 BINYONG SUN AND CHEN-BO ZHU 

Then pullback through the determinant homomorphism det : U{V) U(E) in- 
duces an identification 

fiy(O) = Hom(U(y),C^) = Hom(U(E),C^). 

Hilbert's Theorem 90 says that the map 

EVF^^U(E), x^- 

x'- 

is a topological isomorphism. Therefore we have a further identification 

fiy(O) = U(E) = E><7f><. 

Note that E^/F^ is a quotient of K, and E^/F^ is a subgroup of K of index two. 
It is easy to check that the restriction of uy to ^2^(0) equals the inclusion map 
gx^px <^ This implies that flM]) is injective and the image of f l5^ contains 

E^F^"- 

Consider the exact sequence 

1 ^ eVF'x ^ K x^/2z Wo^Wo-^ 1, 

where po is the projection map. Note that the restriction of po to the image of 
(IMI) is surjective. Therefore the image of (1511) equals K SUq since it already 

contains E^/F^. This finishes the proof. □ 

Case 4: U(y) is a non-archimedean quaternionic symplectic group. 
Recall the discriminant map (for quaternionic skew-Hermitian spaces) 

disciSHo ^ FV(FX)2, 
{W,{^)w) ^ (-l)'^det[(ei,ejV]i<ij<m, 

where ei, 62, ■ • ■ , Cm is a basis of 1^. 

Lemma 3.9. IfUiV) is a non-archimedean quaternionic symplectic group, then 
we have an exact sequence 

1 ^ {1, } ^ SUy = 2no ^ K = F><7(i^)2 ^ 1, 

where is the element o/SUq represented by the dimensional anisotropic skew- 
Hermitian left D-vector space. For every a G QUq, we have 

z/y(a) = (disc((T), ■ )f. 

Proof. See |Yat Section 6]. □ 

Case 5: U(F) is a non-archimedean quaternionic orthogonal group. 

In this case, there is a unique homomorphism U(V^) — > Y'^ /{F'^)^ which extends 
the map /iy : U(l^)spiit ^ K = Y''/{Y''f (see [Ml Section 2]). We still denote it 
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by iiv It also follows from |Wa[ Section 2] that every character of U(\^) uniquely 
descends to a character of F^/(F^)^. Therefore the homomorphism 

Mk(0):fiv(0)^FV(F^)2, 

which equals the descending of characters through : U(K) — )■ F^/(F^)^, is an 
isomorphism. 

Now the following lemma is clear. 

Lemma 3.10. //U(V^) is a non-archimedean quaternionic orthogonal group, then 

vv X dim : Wy ^ F x Z/2Z. 

is a group isomorphism. 

Case 6: U(l^) is a real quaternionic orthogonal group. 
In this case both f2y(0) and K are trivial, and we have 

Lemma 3.11. //U(y) is a real quaternionic orthogonal group, then 21Jv = QHq = 
Z andK = {1}. 

Case 7: U(l^) is a complex symplectic group or a real quaternionic symplectic 
group. 

In this case both VLy{{)) and K are also trivial, and we have 

Lemma 3.12. IfViV) is a complex symplectic group or a real quaternionic sym- 
plectic group, then QUy = QHq = Z/2Z and K = {1}. 

To summarize, we have the following 

Proposition 3.13. The homomorphism uy : Wy — > K' is surjective, and its 
kernel is 

{Z, if\J{V) is a real symplectic group, a real unitary group, 

or a real quaternionic orthogonal group; 
Z/2Z, otherwise. 

3.4. The Kudia kernel. Now assume that V is arbitrary. Let V be a nonzero 
split e-Hermitian right D-vector space so that V is isometrically isomorphic to a 
subspace of V. For every k G K', put 

(35) Wy,^:=4\uy}i^)). 

By Lemma [375t we know that QUv',^ is independent of V. The Kudla kernel in QUy 
is then 

(36) }Cy:=Wy,,„ 

where Kq is the trivial character of K'. 
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Lemma 3.14. The restriction map ly : /Cy — )■ ICy is an isomorphism unless V 
is the zero orthogonal space. Consequently, we have 

{0, U(V^) is the trivial orthogonal group; 

Z, U(V^) is a real symplectic group, a real unitary group, 

or a real quaternionic orthogonal group; 
Z/2Z, otherwise. 

Proof. The first part of tlie lemma is equivalent to tlie following: if U{V) is not the 
trivial orthogonal group, then every character on U{V') is trivial if it has trivial 
Kudla character and trivial restriction to U(l^). This follows by the argument of 
Section 13.31 The second part follows from the first one and Proposition 13.131 □ 

4. Degenerate principal series and the doubling method 

Fix an element k E K' throughout this section. Denote by ^v,k the inverse 
image of Wv,k under the quotient map Qy — QUy. 

4.1. Two results on degenerate principal series representations. Assume 
that V is split of rank r > 0, with a Lagrangian subspace X. By abuse of notation, 
still write k := k o fj,'y ^ Hom(U'(V^)spiit, C^). For s G C, define the following 
normalized degenerate principal series representation of U'{V): 
(38) 

Us) := {/ G C-(U'(V)) I fipx) = KipM^'^fix), p G P'(X), X G \J'{V)}, 

where Pr is as in 02]), and | ■ |x is as in (I2U]) . Under right translations, this is a 
smooth representation of U'(V"). 

For every a = (W, u) G ^v,k, the functional Xx^oW induces a U'(V)-intertwining 
map 

See equation fl^ . Denote by Rg- the image of \1/ (equipped with the quotient 
topology in the archimedean case): 

, . ^ ^ ^ / N ^ / dim a 

(40) R^:=^{co)CU— p,). 

If we extend a; to a representation of (JJ'iV) x U(Vr)) x Hv(H^) so that Xx(^nW 
is U(iy)-invariant, then is the maximal (Hausdorff in the archimedean case) 
quotient of cu on which U(iy) acts trivially. See |Ralj . |MVWj (non-archimedean), 
and jKRlj . |Zh] (archimedean). 

Lemma 4.1. For every a G ^Iv,k with the split rank rank a >r, we have that 

dima 

■K-o- — J-kI Pr)- 
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Proof. The assertion follows from the work of Kudla-Rallis |KR2j . Kudla-Sweet 
|KSj . and Yamana |Yaj (non-archimedean), and Lee-Zhu |LZH ILZ21 \LZ3\ ILZ4j . 
Lee |LLj . and Yamana |Yaj (archimedean). □ 

The first key point of this article is the following proposition, which is responsible 
for the upper bound in conservation relations. 

Proposition 4.2. Let m > 2pr be an integer. 

(i) // U{V) is neither a complex symplectic group nor a quaternionic group, 
then for every t G ^v,k such that dimt = m (mod 2), we have that 

I.(f - Pr) 
St'e2irv>,tVt;o-'et', dim o-'=m -^o"' 

Rcr, if there exists an element a Et of dimension Apr — m; 
0, otherwise 

as iy) -representations. 

(ii) // U(K) is a non-archimedean quaternionic group or a real quaternionic 
orthogonal group, then as \]{y) -representations, 

^^(y ~ Pr) ^ p 

Z^t'e2Hv,«;;CT'Gt',dimCT'=m ^ teOTy.K; ^et, dim cr=4p^-m 

Proof. The assertion can be read off from a number of results in the literature. 
For non-archimedean cases, the relevant results are in Kudla-Rallis |KR2| Intro- 
duction], Kudla-Sweet |KS[ Theorem 1.2], and Yamana |Ya[ Introduction]. For 
archimedean cases, the relevant results are in Lee-Zhu |LZH Introduction], |LZ2[ 
Section 4], |LZ3[ Theorem 1], |LZ4[ Section 6], Lee |LH Appendix], and Yamana 
|Yal Section 9]. □ 



4.2. The doubling method. Now we allow V to be non-split. Put V := V ®V~ 

throughout this article, and note that A := | v G V} is a Lagrangian 

subspace of V. Still assume that V is nonzero. For every s G C, we form the 
(normalized) degenerate principal series representation Ik(s) of U'(V) as in the last 
subsection. Note that there is a natural homomorphism U'(\^) x U'(l^~) — )■ U'(V). 

Let TT G Irr(U'(l^)) be an irreducible representation which is genuine with respect 
to some (and hence all) elements of QUy^K. The theory of local Zeta integrals 
[PgRl [LR] implies that 

Lemma 4.3. For every s G C, 

Homu'(y)(lK(s),7r) 7^ 0. 

The following is a trivial criterion for non-vanishing of theta liftings: 

Lemma 4.4. Let cry G i7v,K ond denote ay := ry(o"v). Then 

Homu'(y)(R<7v,7r) 7^ implies 6^^.(7r) 7^ 0. 
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On the other hand, we have 

Lemma 4.5. Let cry = {W,uj) G Qy,k o-nd denote oy := ry((Tv). Ij k is trivial and 
W is anisotropic, then 

0av(7r) ^ implies Homu'(v)xu'(y-)(R'f7v, tt^tt^) ^ 0. 

Proof. As in (|T5l) . write 

w|j^(l4^)xj;,_(W/) = w|y®a;|y-, w|y G ^v{W), u\v~ G fiy-(Vr). 

The triviahty of k imphes that uj\v and Ci;|y- are contragredient to each other with 
respect to the isomorphism 

U'(l^) X ((\/ Od VT) X F) ^ U'(\/-) X ((V- ®D W^) X F), 

t-^ {g;u,-t). 

Extends ijj\v and wly- to representations of JyvF ^^^1 Jy- ^y, respectively, so that 
they are contragredient to each other with respect to the isomorphism 

(U'{V) xV'{W)) ^ {{V ®bW) xF) -> {V'{V-) xV'{W)) X {{V- ®Y)W) xF), 

{g,h;u,t) t-^ {g,h;u,-t). 

Assume that Q„^,{7i) ^ 0. Then there is an irreducible representation r G 
1tt{\J'{W)) such that 

(41) Homu'(y)xu'(w)(^^|y,7r§r) ^ 0. 

Since W is anisotropic, both vr and r are unitarizable. By taking complex conju- 
gations on the representations in fHT]) . we have that 

(42) Homu'(y-)xu'{i^)(w|y-,7r'^§r^) ^ 0. 
Combining ( 14 ip and f l42p . we have that 

Homu'(y)xu'{y-)((w|v®'^|y-)u'{iy),7r§7r'^) 7^ 0, 

where a subscript "U'(iy)" indicates the maximal (Hausdorff in the archimedean 
case) quotient on which U'(W^) acts trivially. The lemma then follows by noting 
that 

{u\v®Uj\v')v'iW) — R-tTv, 

as representations of U'{V) x 1]'{V^). □ 

Remark: The lemma above is a variant of a more well-known result in the litera- 
ture on local theta correspondence ( |HKS| Proposition 3.1] and |Ku2| Proposition 
1.5]). Note that we include the non-archimedean quaternionic case (for which 
MVW-involutions do not exist). To compensate this, the space W is assumed to 
be anisotropic, which is what we need (for Lemma [5. 3p . 
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5. Non-occurrence of the trivial representation before stable 

RANGE 

Write d := diiiiD V > for simplicity. The purpose of this section is to show 
the following proposition, which is the second key point of this article and which 
is responsible for the lower bound in conservation relations. 

Proposition 5.1. //F is non-archimedean or\J{V) is an orthogonal group, then 

nt^(ly) = 4pd + 2. 

If K,y = Z (that is, U{V) is a real symplectic group, a real unitary group, or a real 
quaternionic orthogonal group), then for every nonzero element t G ICy, 

nt(lv) =4prf + 2 + 4pi(|t| - 1). 

Recall that when F is non-archimedean or U{V) is an orthogonal group, ty 
denotes the anti-split Witt tower, which is the unique generator of /Cy; and if 
t G ICv = Z, |t| denotes the nonnegative integer so that t is |t|-multiple of a 
generator of /Cy. As noted in the Introduction, we have degty = 4pi, and for the 
latter case degt = 4pi|t|. See the explicit description of /Cy in Sections 13.31 and 

m 

Proposition 15. II is trivial when V = 0. We assume that V is nonzero in the rest 
of this section. In view of Kudla's persistence principle. Proposition 15.11 is clearly 
equivalent to the following 

Proposition 5.2. Assume that F is non-archimedean, or U(V^) is a real or com- 
plex orthogonal group, a real symplectic group, a real unitary group, or a real 
quaternionic orthogonal group. Let t be a nonzero element of JCy, and denote by 
o'd-i the element of t of split rank d — 1. Then 

0<x,_,(ly) = O. 

All archimedean cases of Proposition 15.21 are proved in |Pr2| Appendix C] , \Fa.2\ 
Lemma 3.1], |LPTZt Proposition 3.38], and |LH Theorem 1.2.1], and they follow 
easily from the correspondence of i^'-types in the space of joint harmonics |Ho3] . 
where K stands for a maximal compact subgroup. 

For non-archimedean cases, parts of results are in |RaH Appendix] (for orthog- 
onal groups), |KR3[ Lemma 4.2] (for symplectic groups), and |GG[ Theorem 2.9] 
(for unitary groups). Only the non-archimedean quaternionic case is new. Because 
of the lack of MVW-involutions, the approach of |KR3] and |GG] . which uses the 
doubling method, does not work for this case. In the remainder of this section, we 
follow the idea of Rallis ( |Ralt IRa2] , which treat the case of orthogonal groups) to 
provide a uniform proof of Proposition 15.21 in all non-archimedean cases. 

5.1. The result for the non-archimedean case. Now F is non-archimedean 
and d > 0. We introduce the following notation concerning function spaces. For 
every totally disconnected locally compact Hausdorff topological space M, recall 
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that C^{M) denotes the space of (complex valued) locally constant functions on 
M. Denote by C^(M) C C^(M) the subspace compactly support functions. If 
M is a locally analytic manifold over F, denote by D'^{M) and Dy^{M) the space 
of Schwartz densities and Schwartz half densities on M, respectively. If /i is an 
everywhere positive smooth measure on M, then 



A linear functional on D''{M) is called a generalized function on M. Denote 
by C~°°{M) the space of generalized functions on M. It contains C^{M) as a 
subspace. If M carries a locally analytic action of a group G, then the spaces 
D\M), Dli^{M) and (r°°(M) all carry natural G-actions. 

Write (jy = {W°,uv) for the element of ty of minimal dimension {W° is the 
anisotropic space of dimension 4pi). We view uy as a representation of U(l^) 
(when ^'{V) is a metaplectic group, the restriction of uy to ^'{V) descends to a 
representation of \J{V)). Likewise, view ly as the trivial representation of U{V). 

Then Proposition 15.21 amounts to saying that 



where ^ carries the diagonal action of U{V). Since the Haar measure on ^ 
is U(K)-invariant, the validity of fH5]) does not change if we replace Dy^iy^'^) by 

We argue by induction on d, and assume that holds when d is smaller. 

5.2. Non-occurrence of ly in uy. We start with the following observation: 

Lemma 5.1. Let u be a smooth oscillator representation of Jy{W). If V is split 
with a Lagrangian subspace X, and W is anisotropic. Then every linear functional 
on uj is N{X) -invariant if and only if it is invariant under X ®£) W C Hv'(14^), 
where N(X) denote the unipotent radical o/P(X). 

Proof. This follows by using the Schrodinger model of an oscillator representation 



Lemma 5.2. Let u be a smooth oscillator representation of Jv{W). If V is split 
and nonzero, and W is anisotropic and nonzero. Then 

Homu(y)(w, ly) = 0. 

Proof. Let X be a Lagrangian subspace of V. Assume that there is a nonzero 
element A G Homu(y)(ci;, ly). Then Lemma [5.11 implies that A is a scalar multiple 
of Xx(s,uW- This contradicts the equality (PTi) . as all Kudla characters are unitary. 



D'{M) = C'{M)n and D^JM) = C'{M)fi^. 



(43) 



}iomy^y){DlJV''-^) ® uy, ly) = 0, 



r jlfo2l Part II, Section 3]). 



□ 



□ 




Homu(y)(c<;y, ly) = 0. 
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Proof. Introduce the space Y := V (B V~ as in Section which is spht of rank 
1. Write (Jv for the element of ty of minimal dimension (= 4pi). Then by Lemma 
M r^(av) = ay. 

As an simple instance of Proposition \A.2\ we have an exact sequence of repre- 
sentations of U(V): 

(45) R,,^ ^ I«o(pi) ^ Iv ^ 0, 
where denotes the trivial Kudla character. Note that 

as representations of U(V). When restricted to U(V^) x U(V"), 
Z)^(P(A)\U(V)) = Z)^(U(V)^(U(\/) X U(\/-))), 

where 

U(V^)^ := {\J{V) X \J{v-)) n P(A) 

is the group U(V^) diagonally embedded in U(V) x U(V^). We have a U(V) x 
U(V^~)-stable decomposition 

D^{\J{V f\i\J{V) X U(V-))) = D^{\JiV)\i\J{V) X U(V-))) © C/io, 

where Dg stands for the space of Schwartz densities of total volume 0, and po is 
a right invariant positive measure on U(V^)^\ U(V^) x \J(y~). Then uniqueness of 
invariant generalized functions together with the exact sequence fH5l) implies that 

R., - D^{\J{V f\{\J{V) X \J{V~))), 

and furthermore, 

Homu(v')xU(y-)(R'CTv' ® ly-) = 0. 
This proves the result by Lemma [4.51 □ 

Lemma 5.4. One has that 

(46) Homu(y)(a;v', ly) = 0. 

Proof. When ^ is a symplectic space, this is a special case of Lemma 15.21 Now as- 
sume that V is not a symplectic space. Then there is an orthogonal decomposition 
of e-Hermitian spaces V = Vi(BV2 such that dim^ Vi = 1. Then 

Homu(y)(a;y, ly) C Homu(yi)(wy, lyj = Homu(yi) (cuyi O U)V2, lyj = 0, 



28 BINYONG SUN AND CHEN-BO ZHU 

5.3. Reduction to the null cone. Put 

r := {{vi, V2,--- , Vd-i) e V"-^ I {vi, vj)v = 0, Vz, J = 1, 2, ■ ■ ■ , - 1}, 
the null cone in V^'^. Pushing forward of Schwartz densities yields an inclusion 

Recall that f l43p is assumed to hold when d = dinio V is smaller. The aim of 
this subsection is to prove 

Lemma 5.5. Every 

A G Homu(y)(i^^(V^''~') 
vanishes on D''{V'^''^ \ T) ® ojy- 

If (i = 1 or if y is a symplectic space of dimension 2, then F = V^'^ and Lemma 



5.51 is trivial. So assume that either is a symplectic space of dimension > 4, or 
V is not a symplectic space and d> 2. 

Let Vq be a nonzero non-degenerate subspace of V of minimal dimension d^. 
Thus do = 2 if \^ is a symplectic space, and do = 1 otherwise. Denote by V^^ the 
orthogonal complement of Vq in V. Put 

{(■^17 "^2) G (yoY I vi,V2 is a basis of Vq}, if F is a symplectic space; 
^0 \ {0}, otherwise. 



Bo: 
Then 



So := Bo X V^-^-i c V^-^ 



'0 •— J->o 

is stable under U(Vl5^) C U(l^), and the map 

(47) $: l]{V)xSo^V''-\ {g,Y)^g-v 

is a U(y) X U(Vo^)-equivariant submersion, where U{V) x 11(10"^) acts on U(V) x So 
by 

{g,h) ■ (x,v) := {gxh v), 

and acts on V^'^ by 

{g,h)-v := g-v. 

Lemma 5.6. One has that 

(48) Homu(v)xu(v;,^)(^'(U(l^) x ^o) ® ^y, V) = 0, 

where we extend the representations uy and ly ofUiV) to U(V) x U(VIj^) by the 
trivial action ofUiVf^). 

Proof. Frobenius reciprocity |Be[ Section 1.5] implies that the left hand side of 
fHg]l equals 

(49) Homu(y^^)(I)^(5o) ® Mlviv,^), lyx). 
Note that 
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and 

By the induction assumption, we have 

Rom^^y.^iD^iiV.^Y-''^^'') ^uy., Vx) = 0, 

and therefore the space vanishes as welL □ 

Since the map $ is a submersion, its image UiV) ■ Sq is open in V^'^. We have 
the following 

Lemma 5.7. Every element X G Homu(v')(-D'"(V^'^^^) ® wv, ly) vanishes on 

D'{\]{V) ■ So)®ojv. 

Proof. Pushing forward through $ yields a U(V") x U(Vl5^)-intertwining linear map 

: D'{\J{V) X So) D'iV''-'). 
Tensoring with uy, we get a U{V) x U(VQ"^)-intertwining linear map 

® 1^^, : D'{\J{V) X So) ®uv^ D'iy^'^) ® uy. 
Since both D'^iV'^^^) ® uoy and ly carries the trivial U(Vj5^)-action, we have 

A G Homu(y)xU(Vo^)(^'(^''"') ® ^v, ly)- 
Now Lemma [5.61 implies that A o (g) 1^^^) = 0, namely, A vanishes on the image 

of ® 1^^, which is I)^(U(y) ■ 5o) ® UJy. □ 

We are now ready to prove Lemma [5.51 Let the group GLd-iiJ^) act on V^"^ 

by 

This commutes with the action of U(l^). Lemma 15.71 implies that every A G 
Homu(y)(D'^(l^'^~"^) ®ujv, '\-v) vanishes on 

D'{{\]{y)xGU-i{'D))-So)®uJv. 



Lemma 15.51 follows by noting that 

|J(U(V) X GL,_i(D)) ■ So = \ r, 

Vb 

where Vq runs through all non-degenerate subspaces of V of dimension do- 



30 



BINYONG SUN AND CHEN-BO ZHU 



5.4. Vanishing on small orbits in the null cone. Write 

rank V 

r U 



1=0 



where 



Fj := {{vi, V2, - ■ • , Vd-i) & r \ vi,V2, ■ ■ ■ , Vd-i span a D-subspace of V of dimension 

Then each Fj is a single V{V) x GLd_i(D)-orbit. 
Denote by the ring of integers in D: 

Od := {a e D I |deta|B < 1}. 

Lemma 5.8. For each i = 0, 1, ■ • • ,rankl/, F^ is a homogeneous space for the 
action ofUiV) x GL(^_i(Od), and carries a U{V) x GLfi-i{OB) -invariant positive 
smooth measure on it. 

Proof. Fix a decomposition 

V := (eiD © esD © ■ ■ ■ © e^D) © Yi 
such that eiD © © • • • © e^D is totally isotropic. Then the stabilizer of 

Vj = {61,62,- ■■ ,6^,0,0, ••• ,0) e Fj 

in \]{V) x GLd_i(D) is 



Si 





a * 




' a " 


{( 


* 




* * 



e \J{V) X GLrf_i(D) I a e GLi(D) 



The first assertion of the lemma will follow from the equality 

\J{V) X GL,_i(D) = (U(V^) X GLa-i{On))Si. 
This is an easy consequence of the Iwasawa decomposition: 

a 



GLrf^i(D)=GLrf_i(ODj 



eGLrf_i(D) |aeGL,(D)^. 



The second assertion of the lemma follows by noting that (U(\^) x GL(1-i{0-d)) Si 
is unimodular. □ 

Lemma 5.9. If2i < d, then 

Homu(i/)(C^(Fi) ® uv, ly) = 0. 

Proof. Fix an element 

V = {vi,V2, ■ ■ ■ ,Vd-^i) e Ti. 
Since 2i < d, there is a nonzero non-degenerate subspace Vq of V such that 

{v,Vj)v = 0, V eVo, j = l,2,--- ,d-l. 

Then v is fixed by U(Vo) C U(y), and the map 

(50) U{V) X GLa-i{V) ^ F,, {g, h) ^ {g, h) ■ v 
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is a U(y) X U(Vo)-equivariant submersion, where U(y) x U(Vo) acts on UiV) x 
GL,_i(V) by 

{9,h) ■ {x,y) := {gxh~^,y), 

and acts on Fj by 

{g,h) ■x:= g-x. 
As in the argument of last subsection, we have 

Homu(y)(C^(ri) ® wy, Iv) 
^ Homu(y)(I)'(ri) ® wy, ly) (by Lemma ES]) 

Homu(y)xu(yo)(-^^(U(V) x GLd_i(y)) ® wy, ly) (pushing forward of ([50])) 
= Homu(yo)(-D^(GLd_i(V)) (g) {uv)\\j{Vo), Iv;,) (by Frobenius reciprocity) 
= Homu(yo)(I)'(GLd_i(V)) ® (cjyx) ® uy,, Ivo) 
= (by Lemma [5 .41) . 

□ 

5.5. A homogeneity calculation for the main orbits in the null cone. In 

this subsection, assume that V splits. Write d = 2r > 0. View D^^^ as a right 
D- vector space of column vectors. For every subspace Z of D"^"^ of dimension r — 1, 
put 

:= {v G F^ I va = 0, a G Z}. 
By Witt's extension theorem, this is a single U(\^)-orbit, and we have 

r. = □ Oz. 

Z is a subspace of D"*^^ of dimension r — 1 

Let (E = center of D) act on V^^^ by 

a-x:=xa"\ a G E^, x G V^'^^^ 

Then is E^ -stable. 

We will use the following convention throughout this article: if G is a group 
acting on two sets A and B, then for every g E G and every map if : A ^ B, 
g ■ (j) : A ^ B is the map defined by 

{g ■ (j)){a) := g ■ {ip{g~^ ■ a)), a e A. 

If no action of G is specified on a set G, we consider G carries the trivial action of 
G. 

Lemma 5.10. The space Homu(y)(wy, C^{Oz)) is one dimensional and every 
element A of the space satisfies 

a.X = \a\-E'''''°''X, aGE\ 
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Proof. Fix an element = (fi,f2, ■ ■ ■ , va-i) G Oz- Denote by X the Lagrangian 
subspace of V spaned hj Vi,V2, ■ ■ ■ , f d-i- Fix a Lagrangian subspace YofV which 
is complementary to X. For every a G , denote by G U{V) the element which 
stabilizes both X and F, and acts on X through the scalar multiplication by a. 
The stabilizer of in U{V) equals N(X). Therefore 

Oz = U(\/)/N(X). 

The corresponding action of on U(V")/ N(X) is given by 

a-{gN{X)) = gm-'N{X), a e E\ 

By Frobenius reciprocity, 

(51) Homu(v)(u;v, C^(Oz)) = HomN(x)(c^v, C). 

It is easy to check that, under the identification f lFI]) . the action of E^ on the left 
hand side corresponds to the following action on the right hand side: 

a ■ := o (wy(m~^)), a G E^, G HomN(x)(wy, C). 

By Lemma l5TT| HomN(x)(i^y) C) is spanned by Xx(g)W°, and f l2T|) implies that 

■> / / _ I |-2pidQr, 

'^X^VK" ° I'^Vl'^a JJ — I'^Ie ■^X^W°- 

□ 

Lemma 5.11. Every element A G Homu(y)(wy, (7~°°(rr)) satisfies 

, I |-2pi d?) r , ^ tX 

a ■ A = |a|^ "A, a G E . 

Proof. Without loss of generality, assume that A is GLd_i{Oj:,)-fimte. Then the 
image of A is contained in C^lTr), and the lemma follows by Lemma [5.101 and by 
considering the following product of restriction maps: 

Z is a subspace of D''"^ of dimension r — 1 

□ 

Lemma 5.12. Let /ip^ be as in Lemma \5. Si . Then for every a G E^, the pushing 
forward through 

(52) Tr — )■ Tr, X xa~^ 

, I 1 2 d?) rpr 

maps jjTr to \a\^ ^Tr- 

Proof. View E^ as the center of GLd-iiJ^) via the diagonal embedding. Identify 
r.r with 

(53) {\]{V) X (EXGL,_i(0d)))/5';, 

where 5"° := Sr H (U(\^) x {E'^ Ghd-iiO-c))) , and Sr is as in the proof of Lemma 
15. 8[ Then the map flS2]) corresponds to the left translation by a G E^ on flS5]l . 
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It is routine to check that the modulus character on S° extends to the positive 
character 

V{V) X (E^GL,_i(Od)) ^ M^, {g, ah) ^ \a\ 
Then the current lemma will follow from the next lemma. □ 



2 rpr 
\E 



Lemma 5.13. / [Lol Theorem 33D]^ Let G be a unimodular locally compact Haus- 
dorff topological group, with a closed subgroup S . If there is a positive character 
X : G — 7- M.^ which extends the modulus character of S, then up to scalar multipli- 
cation, there is a unique nonzero Borel measure fi on G/S such that 

g*!^ = xig)i^, g ^G, 

where g^, is the pushing forward of measures through the left translation on G/S 

by g- 

5.6. Conclusion of proof. 

Lemma 5.14. If V does not split, then 

(54) Homu(y)(I)i^/2(^''"') ® ooy, ly) = 0; 

ifV splits and d = 2r, then every element A of the left hand side of ( 154|) satisfies 

a- X= \a\~'^°'^\, aGE\ 

Proof. Denote by fiyd-i a Haar measure on V^'^. As representations of E^, we 
have that 

Homu(y)(l?i%(^'"')®c^y,ly) 
= Homu(y)(C^(V^'^-') ® oov, ly) ® Homc(/iJ/I„ C) 
^ Homu(v)(C^(V'^-') ®a;y,ly) ® \.\-^''"^''^''-'^ 

(55) = Homu(y)(C^(r)®u;y,lv')® 1-17''°^^''"'^ (by Lemma [53]). 



If V does not split, then the space fl55|) vanishes by Lemma [5 .91 This proves the 
first assertion. Now assume that V splits and d = 2r. Then Lemma 15.91 implies 
that the space embeds into 

Homu(y)(C^(r,) ® wy, Iv) ® l-l^^'^DrfC'i-i) 
= Homu(y)(I)^(r,) ® uv, ly ® C/irJ ® 

= Homu(y)(D^(r,)®u;v',ly)® M?''"''^''"'^^'''"'''''' (by Lemma EE]) 

= Homu{y)(wy, CT (r^)) ® He 
Therefore by Lemma 15.111 every A in the left hand side of (IMIl satisfies 



□ 
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For every e-Hermitian right D-vector space {V, (, define an e-symmetric 
F-bilinear form on it: 

{U,v)v' + {u,vYy, 

{u,v)v^ := . 

Define tlie Fourier transform J-'y on Dy^iV) by 



1 



x):= f{y)^{{x,y)v') dfiv'iy), f e C'{V'), x e V , 



1 

wliere ^v' is tlie Haar measure on V' so tliat J^v' preserves tlie following inner 
product on Dli^iV'): 



1 1 



Jv 

It is easy to check that 

(56) :Fv>{g.Ti) = 9*{^v'{r])). g e\^{V'), E Dl,,{V'), 
and 

(57) J^y,{{a-\r,) = {a'),{J^y,{'n)), a e E^ e Dl^^iV'), 

where : Dli^iV') — )■ Dlj^iy') is the push forward of half densities through 
g : V ^ V, and for every a G , a^: : D'^^^iV') — > D'^^^iV') is the push forward 
of half densities through the right multiplication on V by a. 

We are now ready to prove the vanishing of the space 

(58) Homu(y)(A'/2(^'"') ® ^v, ly)- 

By Lemma I5.14[ we may assume that V splits. Let A be an element of (l58l) . 
Lemma 15.141 then implies that 



-d2 r2 



1 X 



(59) a - A = |a|^^ A, a G 

Put 

A' := A O {J^yd-l (g) 1^^). 

It is again an element of flSSl) by fISB]) . Again by Lemma 15. 14^ we have that 

a - X' =\a\~'^''"'x', aGE^ 
By (lFr|) . the equation (15^ implies that 

a- X' =\a\f "'x', aGE^ 
Therefore A' = and so A = 0. 
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6. Conservation relations 

6.1. Persistence and non-vanishing in stable range. Now F is any local 
field of characteristic zero. We recall again Kudla's persistence principal \Ku2\ 
Propositions 4.1 and 4.5] and non- vanishing of theta liftings in stable range ( |Ku2| 
Propositions 4.3 and 4.5], and |PP| Theorem 1] for the archimedean case). We 
shall provide a short proof in the notation of this article. 

Proposition 6.1. Assume it G Irr(U'(V^)) is genuine with respect to t G SUy. // 
0", cr' G t and dim cr' > dim a, then 

e^(7r)^0^e^,(7r)^0. 

Proof. Without loss of generality, assume that a' = a + a2, where a2 is the split 
element of dimension 2. Write u,u',U2 for the representation in a, cr',o"2, respec- 
tively. Then u' = u^uj2- By definition, there is a nonzero (continuous in the 
archimedean case) U'(K)-invariant functional on U2. Therefore 

Homu'(y)(w, tt) 7^ ^ Homu'(y)(w', vr) 0. 

□ 

Proposition 6.2. Assume vr G lrr(U'(\^)) is genuine with respect a G O'nd 
rank a > dimD V, then 

e.(7r) ^ 0. 

Proof. By Lemma [2l6] and without loss of generality, we may assume that a G ^Iv,k 
for some k, G K'. Then a = ry((Tv) for some ay G flY,K- Now the lemma follows 
directly from Lemmas 14.11 14.31 and 14.41 □ 

6.2. A lower bound. Theorems I3 [B] and [C] are trivial when V = 0. Unless 
otherwise specified, from now on, assume that V 0, and U{V) is not a complex 
symplectic group or a real quaternionic symplectic group. Both of our key technical 
results (Propositions 14.21 and 15.11) exclude these two cases. 

Recall that d := dimo V. 

Proposition 6.3. Let t,t' G 2IJy be two different elements so that t — t' G /Cy, 
and TT G 1tt{U'{V)) be genuine with respect to t (and hence genuine with respect 
to t'). IfF is non- archimedean or U{V) is an orthogonal group, then 

nt(7r) +n_t'(vr'') > 4pd + 2. 

If JCv = Z (that is, 'U{V) is a real symplectic group, a real unitary group, or a real 
quaternionic orthogonal group), then 

nt(7r) + n_t'(vr'') > 4pd + 2 + 4pi(|t - t'| - 1). 
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Proof. Denote by a G t the enhanced oscillator representation of dimension nt(7r) 
so that 0o-(7r) 7^ 0. Likewise, denote by a' G — t' the enhanced oscillator represen- 
tation of dimension n_t'(7r'^) so that Oo-'(7r^) 7^ 0. Then it is clear that 

Therefore the result follows from Proposition 15.11 □ 
6.3. An upper bound. 

Lemma 6.4. For every k G K' and every tt G Irr(U'(V")) which is genuine with 
respect to some (and hence all) elements ofWv,K, we have that 

(60) n,(7r) := min{nt(7r) | t G Wy,.} < 2pd + 1. 

Proof. Assume that ( 160|) does not hold, then 

^^(Tr) — 1, D is quaternion; 



< ^0 1 _ 2^ otherwise. 

Pick a Witt tower to G QHy^^ such that 

nto(vr) = n«(7r). 

Denote by to the element of QUv.k so that ry(to) = to. First assume that D is not 
quaternion. By Part (i) of Proposition |42| as U'(V)-representations, 



(62) 



St'e2Hv,„,tVto; <T'Gt',dim(T'=no 

Ro-Q, if there exists an element Uo G to of dimension Apd — uq; 
0, otherwise. 



From Lemma 14. 3[ we may pick a nonzero element /i in 

Homu'(y)(lK(Y -pd), vr). 

Since uq < n,^{TT), p vanishes on the denominator of fl62l) by Lemma S31 Therefore 
it descends to a nonzero element of 

Homu'(y)(Rao, tt). 



Lemma [4.41 then implies that 

nto(7r) < dim (To = ipa - uq. 

Since Uq < nto(7r), we have Uq < ipd — Uq, which contradicts (IM]) . For the rest of 
cases, we use Part (ii) of Proposition 14. 2[ and we reach the same contradiction. □ 

Proposition 6.5. For every /Cy coset T in QUy and every vr G Irr(U'(l^)) which is 
genuine with respect to some (and hence all) elements ofT, there are two different 
Witt towers t, t' G T such that 

nt(7r) +nt'(7r) < 4pd + 2. 
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Proof. By Lemma 12.61 and without loss of generality, assume that T = Wv,k, for 
some K G K'. Let to and to be as in the proof of Lemma [631 We have from Lemma 
[63] that 

mo := 4pd + 2 - nto(7r) > 2pd + 1. 

First assume that D is not quaternion. By Part (i) of Proposition 14.21 as U'(V)- 
representations, 



(63) 



X]t'e2IJv,K,tYto; o-'gt',dim(T'=mo 

Ro-Q, if there exists an element do G to of dimension Ap^ — mo; 
0, otherwise. 



Again, we pick a nonzero element p in 

Homu'(y)(I«(^ -pd), vr). 

Suppose that the proposition does not hold for vr and T. Then by Lemma 14. 4[ 
p vanishes on the denominator of (1631) . and so descends to a nonzero element of 

Homu'(y)(R<xo, tt). 

This is not possible as 

dim (To = 4prf - mo = nto(7r) - 2. 

Now assume that U{V) is a non-archimedean quaternionic group or a real quater- 
nionic orthogonal group. By Part (ii) of Proposition 14. 2[ as U'(V)-representations, 

(64) U^-P^) 

2^t'eWY,n;(T'et',diraa'=mo t&Wv,^; tret, dim a=4pa-mo 

We observe that mo has a different parity with ^to(^) (since Apd is odd for D 
quaternion), and so for all the contributing terms in the denominator of fl64l) . we 
have t' 7^ to. We may use the same argument (as in the first case) and conclude 
that the current proposition holds in this second case. □ 

6.4. Proof of main theorems. Assume that we are in the settings of Theorems 
[XI and [Bl and so /Cy = {l,ty}. Let ti,t2 be two elements of 2IJy with difference 
ty. They form a /Cy-coset. Assume that vr G Irr(U'(V")) is genuine with respect 
to ti (and hence to t2). By Propositions 16.31 and 16. 5[ we have 



(65) 



nt,(7r) +n_t,(7r^) > 4pd + 2, 
nt2(7r) +n_ti(7r^) > 4prf + 2, 
nt,(7r) + nt,(7r) < 4pd + 2, 
n_ti(7r^)+n_t2(7r^) <4pd + 2. 



This forces all the above inequalities to be equalities, and we conclude the proof 
of Theorems \M and [B] 
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Lemma 6.6. Assume that F is archimedean. For every vr G Irr(U'(l^)) which is 
genuine with respect to a E Qy, we have 

e^(7r) 7^ if and only if O^v (tt^^) ^ 0. 

Proof. This follows by using MVW-involutions on archimedean metaplectic groups 
and classical groups (cf. |MVWtlPrltlSulj ). MVW involutions for real quaternionic 
groups are discussed in |LST] . □ 

We remark in passing that MVW-involutions do not exist in the non-archimedean 
quaternionic case. Nonetheless the assertion of Lemma 16.61 is still valid for this 
case, in view of the equalities in f l65|) . 

Now assume that we are in the settings of Theorem O Thus F = M and /Cy — 
and we are given a /C^-coset T and tt G Irr(U'(l^)) which is genuine with respect 
to some (and hence all) elements of T. 

By Proposition 16. 5 j there are two different Witt towers t,t' G T such that 

(66) nt(7r) + nt.(7r) <4prf + 2. 

By Proposition 16. 3[ we have 

nt,(7r) + n_t2(7r'') > 4prf + 2 + 4pi(|ti - tzi - 1). 
for any two different elements ti,t2 G T. Lemma [6.61 implies that 

n-t2(7^^) = nt2(vr). 

Therefore 

nt,(7r) + nt2(7r) > 4prf + 2 + 4pi(|ti - tsl - 1). 

This also forces the inequality in (166|) to be an equahty, and the proof of Theorem 
[Cl is now complete. 
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